Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix for several issues with VisionAgent #251

Merged
merged 9 commits into from
Sep 26, 2024
Merged

Fix for several issues with VisionAgent #251

merged 9 commits into from
Sep 26, 2024

Conversation

dillonalaird
Copy link
Member

@dillonalaird dillonalaird commented Sep 26, 2024

Fixes several issues/bugs with VisionAgent:

  • Fixes bug where if you pass a list of size > 2 to edit_vision_code it will crash because you've passed more than one user role message in a row
  • Fixes bug where it would hallucinate when using view_media_artifact
  • Fixes issue where it would try to call view_media_artifact on the users behalf
  • Fixes issue where it could not write numpy arrays with write_media_artifact
  • Adds rule for ensuring it will only call edit_vision_code on code generated from generate_vision_code, as opposed to using edit_code_artifact
  • Adds rule for ensuring it will not continue to modify code for things the user did not ask for. For example, sometimes after generating vision code it would modify it to include visualizations
  • Added more test cases for functions that modify code input and fixed some edge cases

@dillonalaird dillonalaird merged commit d14a76f into main Sep 26, 2024
8 checks passed
@dillonalaird dillonalaird deleted the fix-va-issues branch September 26, 2024 21:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants